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1. Introduction 

Consider an operator equation of the first kind 

Ay = f, y & Hi, feH 2 , (1) 

where Hi and H 2 are Hilbert spaces and A : i7i —>■ H 2 is a linear bounded 
operator. Suppose that the exact solution y is the normal pseudosolution mm- 
Let, instead of the exact / and A, we have / and A such that ||/ — /|| < S, 
S > 0, IIA — A|| < 9, 9 > 0. Denote by 7 = {6,9). Given /, A, 6, and 9, the 
problem is to find an element yj € Hi that is a stable approximation of y such 
that \\y.y — y|| —0 as 7 —0. 

In the classical Tikhonov regularization method (using stabilizers of the type 
112/11 La 112211 Wa")’ solves the equation [TUTU] 

ay^ + A*Ay^=A*f, (2) 

where a > 0 is the regularization parameter. 

Well-known ways for choosing the regularization parameter a were devel¬ 
oped, namely, the discrepancy principle the generalized discrepancy prin¬ 
ciple (GDP) [7], the modified discrepancy principle (MDP) [T^HTT] . the cross- 
validation method [T5], the iteration stopping rule by discrepancy mm, the lo¬ 
cal regularising algorithm m, the adaptive specialized generalized discrepancy 
principle (SGDP) [I], etc. Estimates of the error ||j/a — ?/|| for the regularized so¬ 
lution ya were obtained, among them, with use of an a priori information about 
the solution y (the sourcewise representability, etc.) [TH51[5H^ [TTHT71I^I^ . 
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However, solving a number of model examples shows the following (see [U 
[7], et ah). For finite <5 and 0, the principles can overstate the value of a in 
comparison with aopt ■ As a result, the error 11 ?/a — y 11 is overstated in comparison 
with ||?/aopt ~y||) the solution j/q, becomes more smooth than ?/aopt j “the 
fine structure” of the solution j/q, is lost (cf. [22]). Here, aopt is the value of a 
for which \\ya — y|| = min (the value of Oopt can be determined without strong 
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a priori suppositions about the solution only in solving model examples). This 
effect usually appears when the relative errors i5rei and ^j-ei ^ 1% n p. 283], [7]. 

The aim of this paper is the further development of the new version of a 
posteriori choice of a (NVAC) [2] concentrating attention on the question about 
closeness of a to Oopt and, as a result, of \\ya — y\\ to ||2/appt — y||, furthermore, 
not so much in asymptotics for 6,9 ^ 0, as for finite 6 and 9. In this paper, 
the modified formulations of the NVAC’s statements are given, moreover, as far 
as possible without using the sourcewise representability of y. In this case, the 
solution error estimates for finite 6, 9, and a depend on the exact solution y 
that is known only in model examples. And in asymptotics (for 6, 9, a —>■ 0), 
the order of convergence of ya to y will be obtained. 

Remark 1. Since Oopt and ?/aopt are known only in model examples but are 
unknown in real problems, so the efficiency of the new version must be verified 
for model examples. 

2. The idea of the NVAC 

Let us write Eq. in the form 

aya + Rya = F, (3) 


where R = A*A, F = A* f. 

Along with the operator equation (|T|), consider the Fredholm integral equa¬ 
tion of the first kind 

Ay = f K{x,s)y{s) ds = f{x), c<x<d. (4) 

J a 

In the Tikhonov regularization method, instead of Eq. ®, one solves the 
equation (for Hi = W 2 , H 2 = L 2 ) [H p. 24], [23] 


(^[ya{t)-Ty'^{t)]+ f R{t,s)ya{s)ds = F{t), a<t<b, r > 0, (5) 


vM = y'aib) = 0, 


R{t, s) = R{s,t) = [ K(x,t) K{x, s) dx, (6) 

J C 

A(t)=^ K{x,t)J{x)dx . (7) 

Actually, the original equation in the Tikhonov regularization method is 
the equation A* Ay = A* f rather than Ay = f. Different variants of the 
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discrepancy principle [supHniiiniiii] use the error 6 of the right-hand side 
/. However, the function f{x) does not appear explicitly as a right-hand side 
in the Tikhonov method. The right-hand side is the function F{t) (see ([3]) and 
dS])). The function /(x) comes under the integral sign in the expression for F{t) 
(see 0 ), while the integration operation is a smoothing filter with respect to 
f{x). As a result, random errors in f{x) will be smoothed to a certain extent. 
In this case, the relative error in F{t) can become considerably less than the 
relative error in f{x) [5]. 

Concerning the error 0 of the operator A, th^factual operator in the Tikhonov 
method is the operator R = A* A rather than A. Therefore, in choosing c^from 
^discrepancy, it is more appropriat^y to i^e the errors of the elements F and 
R rather than S and 0 (the errors of / and A). However, on deriving asymptotic 
estimates for a and for an error of the solution > one should use the errors of 
both the elements F and R and ones / and A. 

In the generalized discrepancy principle (GDP) [7], a = Od (from discrep¬ 
ancy) is chosen to be a root of the equation ||Aya ~ / || = {5 + 6 ||ya||)^ -|- JP, 
where Jl — inf Ay — / is the incompatibility measure of the equation Ay = f. 

V 

According to the Kojdecki way [3], a is a root of the equation 

a^||A*Ay„-A7|| =/3||A||(5-f0||y«||) (8) 

or, with regard to ([3]), 


=^||A|| (^-b^llyall) , 

where q > 0 and /3 > 0 are some numbers. One has proved [5] the following 
lemma. 

Lemma 1. The incompatibility measure v = inf i?y — F of the equation 

^ ^ y 

Ry = F is equal to zero. 

Now, we formulate again the new version of the a posteriori choice of a 
(NVAC), moreover, the results obtained in [2] will be given without proofs. 
According to the NVAC, with regard to Lemma 1, the regularization parameter 
a is chosen to be a root of the equation [ 2 ] 

a«||i?y„-F|| =/3(A + 0||y„||), g > 0, /3 > 0, (9) 

or a root of the equivalent equation 

=/3(A-b0||ya||), y > 0 , /3>0, ( 10 ) 

furthermore, \\F — T'|| < A and ||i? — i?|| < 0, where A = A{S,9) > 0 is an 
upper estimate for the error of the right-hand side F and 0 = 0(9) > 0 is an 
upper estimate for the error of the operator R. Denote by T = (A, 0) and by 
an a root of m or (fTIl (the symbol “n” denotes “new”). 

Remark 2. Equation (|9]) is rather like the equation ([ 8 ]). However, these 
equations have the difference of principle, namely, in Eq. ®, the errors 6 and 
9 are used and the factor || A || is separated from <5 and 9, whereas in Eq. (|3]), A 
and 0 are used. Meanwhile, the value of ||A ||((5 -|- 0 ||ya||) can be considerably 
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greater than A + 0 ||?/a|| ■ This difference can lead to overstated values of a and 

Iba -y||- 


3. Justification of the New Version of a Posteriori Choosing a. 

Denote the left-hand side of m or (US as 

V^(a) = a‘>\\Rya - ^ || = ||2/a|| 

and the right-hand side of dH]) or (nni as 

?(«) = /3(A-f 0||ya||). 

Then Eq. ([9]) or (fTOll can be written in the form of the equation 

i}{a)=^{a). ( 11 ) 

Lemma 2 [5]. Under the condition 

||f|| > /3 a, q = Q, ,^ 2 ) 

ill’ll > 0, g > 0 ^ 

the function ip{a) is continuous and strictly monotonically increasing, moreover, 

lim fiia) = 0 , 

a—>^0+ 


lim 'f’ia) 

a—)-+oo 


f ll^ll> 

9 = 0, 




0 , 

q> 0 

and 

F 

= 0, 

[ oo, 

q> 0 

and 

F 

>0, 


and function f,{a) is continuous and strictly monotonically decreasing, moreover, 


lim ^(o) > /3 A > 0 , 

0 :^ 0 + 

lim f{a) = /3 A > 0 . 

Ct—f + CXD 


Now, the NVAC can be formulated as the following^theorem. 

Theorem 1. Let the equation Ay = f, y £ Hi, f £ H 2 , be solved by the 
Tikhonov regularization method according to m or where ||/ — /|| < S, 
<5 > 0, II A — A|| < 9, 9 > 0. Suppose that the regularization parameter a 
is chosen to be a root of Eq. ®, (0 or (ED, furthermore, H-F — E|| < A, 
11^^ ~ ^11 ^ 0, where A = A{S,9) > 0, 0 = Q{9) > 0. Then, under condition 
(ED, a root a = an of Eq. ED exists and is unique, and the solution ya„ can 
be found by solving Eq. with a = On- If condition ED is not fulfilled, then 

2 /an = 0 - 


4. Some dependences 


Let us establish the dependences A = A{6,9) and 0 = <d{9). The estimate 
for the error A of the right-hand side F has the form [5] 


A < ||A|U-f ||/|| 6 », 


(13) 
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and the estimate for the error 0 of the operator R has the form [5] 

0<2||A||6». (14) 

Remark 3. The estimates m and (ITTl) are necessary for justifying the 
convergence of the NVAC. However, in practice for a finite S and 9, the formulas 
(USD and USD may give an overstatement of A and 0 (see example in the end 
of the present paper) and, hence, of if one uses the upper estimates: A = 
||y4|| iJ+ll/ll 9 and 0 = 2 ||A|| 9. This overstatement is caused by that the factor 
||H|| is separated from 5 and 9 in the estimates (USD and da. To obtain more 
exact estimates of A and 0, one can use, for example, the algorithms II, III and 
V from the paper [5]. 

5. Estimates for 


We give two upper estimates for q;„ in the NVAC. Define 0, m p- 78] 


ao = ||i?|| = ||Af = ||A* 
The condition (IT^ for g = 0 can be written as 



(15) 


(16) 


Let us introduce as an extended variant of condition da the following con¬ 
dition 0 


A 0 1 \\R\ 

H-^ ! 

Ell ||i?|| /3 2 


(17) 


Condition da can also be considered as a modification of condition (53) 
in 0 . It is proved 0 

Lemma 3. Under condition da, one has the inequality 


■*/'(ao) > C(ao). 


(18) 


Corollary 1 0 . Since the functions '^(q:) and ^(a) are increasing and 
decreasing, respectively, relations da, da, da imply that 

CCn < Cto = ||7?|| . (19) 

Inequality (1191) gives an upper estimate for in terms of the norm of the 
operator. It is also proved 0 

Lemma 4. Under condition da, it holds that 


C^n A 


P 



A + Q 




( 20 ) 


Inequality da gives another upper estimate for (in terms of the errors 
in the original data). 
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Corollary 2 [5]. Since 


2 \\R\\ , 2 \\R\\ 1 , 

A + 0 < max I ii^ii ’ ^ j (^ + ®) > 

the estimate (pn|) can be written as 

Q!n < Ci(A + 0)l/(9+l) ^ 


( 21 ) 


Cl = 


/3-max{2||i?||/||i^||, l} 




> 0 . 


( 22 ) 


Corollary 3 [5]. Inequality (PT]) generates the asymptotic estimate 

an = Ci((A + 0)i/('?+i)) , A,0^O. (23) 

Using (USD and m, we can write the estimates (EU and (l22ll also as 

an < C2{S + (24) 


C2 


2/3P||.max{||i?||/||F||,P||.||/|l/||F|| + l} 


l/(9+l) 


> 0. 


(25) 


a„ = o((J + 6»)i/(«+i)) , 6 , 9 ^ 0 . (26) 

The relations (1^ . (1^ . (IMl) . (ESI) show that the estimate for Un decreases 
with decrease of j3. 


6. Error Estimate for the Regularized Solution 


We give a new, more precise, estimate for the error \\ya^ — y\\ of the regu¬ 
larized solution ya^ in the NVAC. In the papers [310IU[il[^|lT] et ah, it was 
shown that in the Tikhonov regularization method there holds the following 
error estimate for the regularized solution (on the assumption that the exact 
solution y is sourcewise representable with index I, i.e. y = A*Aw, w G -ffi): 


hoc 


y\\ < C3 


s + e 

\fa 


-h C 4 Q , 


(27) 


where C3, C4 > 0 are some constants. 

Let us use the estimate ((27l) . For On = O ((i5 -I- 0)^/^'^+^^) (see (IMll l there 
exist such positive constants oi and 02 that (cf. [HI P- 65]) 

ai((5 + 0)i/(9+i) < < 02(5 + 0)i/(9+i) . (28) 


Hence, 

||yc„ - y|| < ^ (5 + 0)(9 +o-5)/(9+i) + 0402 ((5 + 0)i/(9+i). (29) 

VOi 


6 









The estimate (ESI) makes possible to obtain the following asymptotic esti¬ 
mates. 

For sufficiently small 6 and 0, we have: 

llycn - y|| < c((5 + 0)*^, OO, (30) 

~ min{g + 0.5, 1} f (g + 0 . 5 )/(g + 1 ), g e [0, 0.5], . . 

g + 1 1 1/(9 + 1), g > 0.5. 

As d, 0 —0, we obtain the asymptotic estimate for the convergence rate of 
2/a„ to t/: 

llyc..-0ll = o((<5 + 0)^), (32) 

as well as (we write again the estimate for j/q„) 

a„ = o((d + 0)i/(9+i)y (33) 

The best asymptotic estimates are obtained for g = 0.5: 

\\yc.^-m = o({5 + ef/^), On = o((d +0)2/3), (34) 

i.e. the optimal order of convergence is obtained. This is conform to results 
of the papers HMsun] et ah, in which the optimal order of convergence has 
also been obtained, but for other ways for choosing a (the modified discrepancy 
principle, etc.). 

If, e.g., <7 = 0 then Hj/q,, — y\\ = O ((d + 0)^/^) - the suboptimal order of 
convergence as in the GDP [7]. 

7. Final Theorem 

In conclusion, we prove the summarizing theorem. 

Theorem 2. Let the equation (El) he solved. Furthermore, the regularization 
parameter a is chosen with the help of the NVAC according to dill) by equal 
a = an- In this case, the estimates (HHl-Eni) for On and the estimates ESD- 
EH) for the error \\ya„ ~ vW of the regularized solution ya„ are valid. One has a 
convergence of the regularized solution ya„ to the exact solution y as 6,0 ^ 0, 
i.e. the NVAC generates a regularizing algorithm. 

Proof. According to (|5(I1) . (EH), ||?/a„ — y||—^-OasJ, 0—7 >0. This means that 
2 /q,„ —> y. Theorem 2 is proved. 

8. Numerical example 

To realize the new version of the a posteriori choice of a, we have developed 
the program package NVAC using Fortran PowerStation 4.0. The following 
model example (cf. [101 P- 162]) was solved with the help of this package. 

The exact solution was set as a superposition of five gaussians (the solution 
with variations): 

y{s) = g g-[(s+0.41)/0.075]^ 

+ 12e“[(®“°-34)/0-084]'' ^4g-[(s-0.41)/0.095]= 9 g-[(s-0.67)/0.065]''^ 
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a = —0.85, b = 0.85, c = —I, d = I, the kernel 


Kix,s) = , 

where the exact value r is r = 59.924. The numbers of discretization nodes 
are I = 161 (on x) and n = 137 (on s and t). The discretization steps are 
Ax = As = At = const = 0.0125. In this example, ||y|| = 7.606, ||/|| = 6.907, 
||A|| = 2.419, ||F|| = 7.216, ||i?|| = 2.196. Figure [T] shows the exact solution 
y(s), the right-hand side f{x) (considerably more smooth than y(s)), and the 
new right-hand side F{t) (still more smooth than /(x)). 



-1 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 0.8 1 

S, X, t 

Figure 1:1— y(s); 2 — /(x); 3 — F{t) 

At first, the direct problem was solved. The values fi, i = were 

calculated. The errors Sfi distributed by the normal law with zero expectation 
and with the mean square deviation 5 = 0.0001, 0.15 and 0.5 were added to the 
values fi- The values r = 59.920, 60 and 65 were used instead of the exact value 
of r. Table 1 shows, as an instance, the values of <5, 5/||/||, A = ||AF||, A/HFH 
and (for comparison) ||A||5-|-||/||0 for r = 60. Such value of r corresponds to the 
following parameters: 0 = ||AA|| = 1.321-10“^, 0/||A|| = 5.46-10“"^ = 0.0546%, 
0 = ||Ai7|| = 1.194-10-3, 0/||A|| = 5.44-10-4 = 0.0544%, 2\\A\\0 = 6.392-10-3. 


Table 1 


s 

s/\\f\\ 

A = ||AF|| 

A/||F|| 

ms+\\f\\o 

0.0001 

1.448-10-3 

ft! 1.4-10-3% 

0.6691 -10-3 

0.927-10-^ 
ft 0.93-10-2% 

9.4-10-3 

0.15 

2.172- 10-^ 

ft 2.2% 

0.01878 

0.259-10-2 

ft 0.26% 

0.3721 

0.5 

7.239- lO-"" 

ft 7.2% 

0.06256 

0.867- 10-2 

ft 0.87% 

1.219 


Furthermore, the operator norms ||A||, 6 = llA —All, ||i?||, and 0 = 111? —i? 






























were calculated by means of the Hilbert-Schmidt norm, e.g., 


Pll = 



1/2 


3 ) dx ds 


Comparing the values of A and ||^||^ + \\f\\d, as well as 0 and 2||A||0 (see 
m and (HU)) we see that the upper estimates ||A||(5+1|/||0 and 2||yl||0 overstate 
by one order the values of A and 0, and comparison of 5/||/|| and A/||F|| shows 
that A/||F|| less by one order than (5/||/|| for (5/||/|| > 1%. About this, one says 
already above. 

Aftewards, the inverse problem was solved. Equation m was solved by the 
quadrature method at r = 1 [3] pp. 249-251]. Figure [5] shows some curves of 
the relative solution error Hy^ — y||/||y|| (it can be calculated only in solving a 
model example with known y). 

1 

0.9 
0.8 
0.7 
0.6 
0.5 
0.4 
0.3 
0.2 
0.1 
0 

-11 -10 -9 -8 -7 -6 -5 -4 -3 -2 -llga^ 

Figure 2: The relative solution error Wy^ — y||/||y|| atr=14 — 6 = 0.0001, 
r = 59.920; 2 — S = 0.15, r = 60; 3 — S = 0.5, ?'= 65 


Table 2 shows, as an instance, the values of aopt, c^n and the relative errors 
of the solutions ya^pt and y^^ for r = 60, y = 0, r = 1, ^ = 1 and /? = 0.1. 

_ Table 2 _ 


(5 

1§ n^opt 

baopt -y\\/\\y\\ 

Ig an 

ban -y\\/\\y\\ 

P = 1 

/3 = 0.1 

/3 = 1 

/3 = 0.1 

0.0001 

-8.7 

0.0385 

-5.1 

-6.2 

0.2107 

0.1099 

0.15 

-5.8 

0.1848 

-4.3 

-5.7 

0.3466 

0.1858 

0.5 

-5.2 

0.2644 

-3.6 

-5.2 

0.4311 

0.2644 



Figure [3] shows the logarithms of the functions '(/’(a) = Q;^||i?ya — and 

C(a)=^(A + 0||2/„||). 

Figure |4] shows the exact solution y(s) and the regularized solutions ya{s) 
at a = aopt = 10“^'®, a = an = 10“®'^ (/3 = 0.1) and a = an = ® {/3 = 1) 

for S = 0.15, r = 60, g = 0, r = 1. 

The author thanks Prof. M.A. Kojdecki for useful discussion of paper results. 
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-11 -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 ig a 0 


Figure 3: 1 — lg'0(a); ^ — IgC(a), /3 = 1; 5 — Ig^(a), /3 = 0.1 



Figure 4: 1 — y(s); 2 — Vais), a = Oopt = 10 ® 3 — ?/a(s), a = «„ = 10 

/3 = 0.1; — j/a(s), a = an = lO”'^-^; P = 1 
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